A survey examined how policy-makers and practitioners used evidence to inform their work, and whether there was demand for better evidence sharing across the United Kingdom. The report said that university research was the most trusted form of evidence, but it could not be accessed by many potential users. It said there was a case for greater sharing of good quality, timely, and relevant information.
Source: Jim McCormick, Evidence Exchange: Learning from social policy from across the UK, Carnegie UK Trust
Links: Report | Carnegie press release
Date: 2013-Dec
An article examined young people's participation in decisions that affected them, drawing on three research and evaluation projects that were undertaken in partnership with young people as researchers.
Source: Jennie Fleming, 'Young people's participation – where next?', Children & Society, Volume 27 Number 6
Links: Abstract
Date: 2013-Dec
A special issue of a journal examined knowledge mobilization and research impact in the social sciences.
Source: Contemporary Social Science, Volume 8 Number 3
Links: Table of contents
Notes: Articles included:
Tim Blackman, 'Rethinking policy-related research: charting a path using qualitative comparative analysis and complexity theory'
Pam Carter, Roger Beech, Domenica Coxon, Martin Thomas, and Clare Jinks, 'Mobilising the experiential knowledge of clinicians, patients and carers for applied health-care research'
Sarah Banks, Andrea Armstrong, Kathleen Carter, Helen Graham, Peter Hayward, Alex Henry, Tessa Holland, Claire Holmes, Amelia Lee, Ann McNulty, Niamh Moore, Nigel Nayling, Ann Stokoe, and Aileen Strachan, 'Everyday ethics in community-based participatory research'
Date: 2013-Dec
An article proposed a deprivation index that weighted different dimensions according to their perceived importance by members of alternative reference groups. Applying this method to European data, it found that preferences over dimensions were differentiated by reference groups. This differentiation affected the value of deprivation for each country and group, and the ranking of each.
Source: Luna Bellani, 'Multidimensional indices of deprivation: the introduction of reference groups weights', Journal of Economic Inequality, Volume 11 Number 4
Links: Abstract
See also: Luna Bellani, Multidimensional Indices of Deprivation: Should Reference Groups Matter?, New Directions in Welfare II, OECD Universities' Joint Economics Congress
Date: 2013-Dec
A government report outlined the preliminary results from a randomized control trial to test methods, informed by the behavioural sciences, for increasing registration on the NHS Organ Donation Register. It said the trial found that making small changes to pages viewed on the government website led to significantly increased registrations. The report said that the work had highlighted the value of using randomized control trials, and of trialling several variants prior to implementation.
Source: Applying Behavioural Insights to Organ Donation: Preliminary results from a randomised controlled trial, Cabinet Office/NHS/Department of Health/Government Digital Service/Driver and Vehicle Licensing Agency
Links: Report
Date: 2013-Dec
An article proposed an innovative statistical matching method to combine the advantages of large national surveys and time diary data.
Source: Cristina Borra, Almudena Sevilla, and Jonathan Gershuny, 'Calibrating time-use estimates for the British Household Panel Survey', Social Indicators Research, Volume 114 Number 3
Date: 2013-Dec
A paper discussed research on improving the accuracy of children's survey responses. It described two randomized experiments and concluded that the avoidance of ambiguity in the presentation of the response options was important.
Source: Kate Smith and Lucinda Platt, How Do Children Answer Questions About Frequencies and Quantities? Evidence from a large-scale field test, Centre for Longitudinal Studies (University of London)
Links: Paper
Date: 2013-Dec
An article examined how research habits were improvised and shaped in the field. It proposed a new term, 'experimental partnering' to define an interpretative approach that was mindful of improvisatory or unstable temporary alignments and their impact.
Source: Emma Roe and Beth Greenhough, 'Experimental partnering: interpreting improvisatory habits in the research field', International Journal of Social Research Methodology, Online first
Links: Abstract
Date: 2013-Nov
An article examined the activities of one United Kingdom university in attempting to foster interdisciplinary research. It found a range of activities that had supported interdisciplinarity, but noted other areas such as time and workload, motivation and loss of identity that had impeded progress across the institution.
Source: Tony Townsend, John Pisapia, and Jamila Razzaq, 'Fostering interdisciplinary research in universities: a case study of leadership, alignment and support', Studies in Higher Education, Online first
Links: Abstract
Date: 2013-Nov
A paper examined the existing literature about disabled people's relationship with poverty in the United Kingdom. It considered the methodological complexities in relation to measuring 'disability' and measuring poverty in relation to disabled people. It reviewed recent policy initiatives and their anticipated impact on the lives of people with disabilities. It said that more nuanced distinctions between different experiences and contexts of disability and of poverty were important for the development of policy. It made recommendations for future research.
Source: Pauline Heslop, Disabled People and their Relationship with Poverty, Working Paper – Methods Series 23, PSE UK
Links: Paper
Date: 2013-Nov
A report examined progress made in implementing the findings of the Finch Group Report which, in 2012, had recommended a programme of action to enable more people to read and use the publications arising from research. The progress report said that 'substantial moves' had been made towards implementing proposals. It called for key stakeholders to continue to work together to: create a formal co-ordinating structure; continue to develop repositories and systems to deal with all categories of open access materials; monitor the impact of open access policies on learned societies; co-ordinate better communications with the research community; and create an evidence base to inform ongoing policy development. Other recommendations included: further modeling around costs and funding; and further policy work at the international level.
Source: Accessibility, Sustainability, Excellence: How to expand access to research publications – a review of progress in implementing the recommendations of the Finch Report, Working Group on Expanding Access to Published Research Findings
Links: Report | Finch Group Report | Government response to Finch Group Report | Russell Group press release
Date: 2013-Nov
An article examined the customization of realist review methods for participatory research assessment. The article outlined a number of key factors in the process and concluded that the timing of the customization process would be informed by the degree of heterogeneity of the evidence base.
Source: Justin Jagosh, Pierre Pluye, Geoff Wong, Margaret Cargo, Jon Salsberg, Paula Bush, Carol Herbert, Lawrence Green, Trish Greenhalgh, and Ann Macaulay, 'Critical reflections on realist review: insights from customizing the methodology to the needs of participatory research assessment', Research, Synthesis Methods, Online first
Links: Abstract
Date: 2013-Nov
An article examined the development of coproduction as a means of rethinking relationships between researchers and 'the researched'. It offered a critique of the existing model of research ethics that viewed communities as vulnerable research subjects, and considered ideas around public value and the rejection of the public harm model. It said that reflexive research practice should draw upon the idea of empowerment within governance, to work towards greater community control in defining and creating research.
Source: Yasminah Beebeejaun, Catherine Durose, James Rees, Jo Richardson, and Liz Richardson, 'Public harm or public value? Towards coproduction in research with communities', Environment and Planning C: Government and Policy, Online first
Links: Abstract
Date: 2013-Nov
A paper examined issues that arose in defining public sector institutions and, in particular, consistency in defining the 'central public administration' across European states.
Source: Isabella Biletta, Jorge Cabrita, and Christina Gotzelmann, Eurofound's Definition of Central Public Administration, Working paper, European Foundation for the Improvement of Living and Working Conditions
Date: 2013-Nov
A report examined the consequences of Scottish independence for the United Kingdom research environment, including publicly funded institutions. It said that the research base was important to the United Kingdom's (including Scotland's) innovation and economic success, and highlighted ways in which Scottish research benefited from its wider connections.
Source: Scotland Analysis: Science and research, Cm 8728, Department for Business, Innovation and Skills, TSO
Links: Report | DBIS press release | Universities Scotland press release | BBC report | Guardian report
Date: 2013-Nov
A report by a committee of MPs said that the government should improve its mechanisms for setting priorities for publicly funded research, based on identified objectives. The report noted that research could deliver a range of direct and indirect benefits, including the provision of evidence to underpin government policy. The committee said there were issues that could not be fully explored in the time available, such as the balance between responsive and targeted research, and the issue of research impact, to which they may return in future work.
Source: Setting Priorities for Publicly Funded Research, 3rd Report (Session 2013–14), HC 104-I, House of Commons Science and Technology Select Committee, TSO
Date: 2013-Nov
An article examined the views of health services staff, practitioners, researchers, and patients on a potential register of volunteers interested in research participation. The research noted implications for the design of research registers.
Source: Aileen Grant, Jenny Ure, Donald Nicolson, Janet Hanley, Aziz Sheikh, Brian McKinstry, and Frank Sullivan, 'Acceptability and perceived barriers and facilitators to creating a national research register to enable 'direct to patient' enrolment into research: the Scottish Health Research Register (SHARE)', BMC Health Services Research, Volume 13
Date: 2013-Oct
A new monthly online magazine was launched covering social research and policy, containing short research-based articles, policy briefings, and viewpoints.
Source: Bulletin September 2013, Academy of Social Sciences
Links: Academy press release | Online access
Date: 2013-Oct
An article examined published guidance for the economic evaluation of public health interventions and outlined a 12 point checklist to support government, National Health Service commissioners, and health economists in their consideration of economic evaluation methodology.
Source: Rhiannon Tudor Edwards, Joanna Mary Charles, and Huw Lloyd-Williams, 'Public health economics: a systematic review of guidance for the economic evaluation of public health interventions and discussion of key methodological issues', BMC Public Health, Volume 13
Date: 2013-Oct
An article examined the availability of longitudinal or nationally representative cross-sectional sources of information on the health and well-being of older adults residing in care homes in the United Kingdom and Ireland. The article concluded that most longitudinal and nationally representative cross-sectional studies did not include or follow up older adults in care homes.
Source: Danielle Collingridge Moore and Barbara Hanratty, 'Out of sight, out of mind? A review of data available on the health of care home residents in longitudinal and nationally representative cross-sectional studies in the UK and Ireland', Age and Ageing, Volume 42 Number 6
Links: Abstract
Date: 2013-Oct
An article examined the conduct of research with young children. It was important to consider not only the data produced but also the research process itself. Issues included: ethical considerations; notions of shared perspectives, recurring images, and socially constructed images; the perceived 'reality' of the events depicted; differences between children's perspectives and adults' perspectives; the risk of intervention; and the competence of children in the research process.
Source: Amy Macdonald, 'Researching with young children: considering issues of ethics and engagement', Contemporary Issues in Early Childhood, Volume 14 Number 3
Links: Abstract
Date: 2013-Sep
A paper examined the role that survey design features played in gaining respondents consent to data linkage. Interview features such as question format (dependent/independent questions) and placement of the consent question within the questionnaire had an impact on consent rates.
Source: Emanuela Sal, Gundi Knies, and Jonathan Burton, Propensity to Consent to Data Linkage: Experimental evidence from the innovation panel on the role of three survey design features, Understanding Society Working Paper 2013-05, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract | Understanding Society press release
Date: 2013-Sep
A report by a committee of MPs said that the coalition government's commitment to increasing access to published research findings, and its desire to achieve full open access, were welcome. But although 'gold' open access was a desirable ultimate goal, focusing on it during the transition to a fully open access world was a mistake.
Source: Open Access, Fifth Report (Session 2013-14), HC 99, House of Commons Business, Innovation and Skills Select Committee, TSO
Links: Report | Additional written evidence | Committee press release | CILIP press release | RIN press release | Russell Group press release | Guardian report | Times Higher Education report
Date: 2013-Sep
A paper examined the 'following rules' in the EU-SILC survey (defining which sample members should be followed up and re-interviewed from one wave of the survey to the next, and which people did not need to be followed). It considered the percentages of the sample re-interviewed following household splits, and assessed the implications of these for the suitability of the survey for longitudinal analysis of the effects of such splits.
Source: Maria Iacovou and Peter Lynn, Implications of the EU-SILC Following Rules, and Their Implementation, for Longitudinal Analysis, Working Paper 2013-17, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract
Notes: EU-SILC = European Union Statistics on Income and Living Conditions
Date: 2013-Sep
A paper examined the use of regression analysis of multi-level country datasets, by reference to EU-SILC data on women's employment probabilities and work hours. With large sample sizes of individuals within each country but a small number of countries, analysts could reliably estimate individual-level effects within each country: but estimates of parameters summarizing country effects were likely to be unreliable. Multi-level (hierarchical) modelling methods were commonly used in this context but they were 'no panacea'.
Source: Mark Bryan and Stephen Jenkins, Regression Analysis of Country Effects Using Multilevel Data: A cautionary tale, Working Paper 2013-14, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract
Notes: EU-SILC = European Union Statistics on Income and Living Conditions
Date: 2013-Aug
A paper examined the impact of mixing modes on data quality indicators in longitudinal studies. Two designs, single-mode face-to-face and multi-mode telephone/face-to-face, led to equally reliable and stable data for the 33 variables analyzed.
Source: Alexandru Cernat, The Impact of Mixing Modes on Reliability in Longitudinal Studies, Working Paper 2013-09, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract
Date: 2013-Jul
An article examined how qualitative comparative analysis (QCA) could be used to address complex policy problems at a local level, using the example of high rates of teenage conceptions in England's most deprived local authority areas. QCA was a promising method for providing evidence in situations where interventions interacted with contexts, enabling causal pathways to be discerned from how sets of conditions combined with particular outcomes: in the instance involved, whether inequalities in conception rates did or did not narrow, compared with the England average.
Source: Tim Blackman, Jonathan Wistow, and Dave Byrne, 'Using qualitative comparative analysis to understand complex policy problems', Evaluation: The International Journal of Theory, Research and Practice, Volume 19 Number 2
Links: Abstract
Date: 2013-Jul
A paper highlighted the importance of randomization bias (where the process of participation in a social experiment was affected by randomization per se) by reference to the Employment Retention and Advancement (ERA) experiment.
Source: Barbara Sianesi, Dealing with Randomisation Bias in a Social Experiment Exploiting the Randomisation Itself: The case of ERA, Working Paper 13/15, Institute for Fiscal Studies
Links: Paper
Date: 2013-Jul
An article examined the epistemological underpinnings of social work research and disability studies research. It considered the tensions, possibilities, and power dynamics of collaboration between the two research disciplines, and outlined possibilities for social model approaches to social work research.
Source: Kathy Boxall and Peter Beresford, 'Service user research in social work and disability studies in the United Kingdom', Disability & Society, Volume 28 Number 5
Links: Abstract
Date: 2013-Jul
An article examined how more than 200 experiments in psychology, criminology, education, and social work were reported in leading journals. It said that the reports did not carry full details about how the interventions were implemented, and that money would continue to be wasted until this situation was rectified.
Source: Sean Grant, Evan Mayo-Wilson, Gerardo Melendez-Torres, and Paul Montgomery, 'Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications', PLoS ONE, Volume 8 Number 5
Links: Article | Oxford University press release
Date: 2013-Jul
A paper examined the methodological challenges of data collection, measurement, and analysis in ageing cohort studies. It said these problems would become increasingly acute as participants grow older, and considered possible responses.
Source: Tarani Chandola and Susan O Shea, Innovative Approaches to Methodological Challenges Facing Ageing Cohort Studies, National Centre for Research Methods (University of Southampton)
Date: 2013-Jun
A special issue of a journal examined the role of evidence and evaluation in social policy.
Source: Social Policy and Administration, Volume 47 Number 4
Links: Table of contents
Notes: Articles included:
Christopher Deeming, 'Trials and tribulations: the "use" (and "misuse") of evidence in public policy'
Katherine Smith, 'Understanding the influence of evidence in public health policy: what can we learn from the "tobacco wars?"'
Trude Sundberg and Peter Taylor-Gooby, 'A systematic review of comparative studies of attitudes to social policy'
Ray Pawson and Geoff Wong, 'Public opinion and policy-making'
Tina Haux, 'Understanding employment barriers for lone parents in Great Britain: research gaps and missed opportunities'
Liz Richardson, 'Putting the research boot on the policymakers' foot: can participatory approaches change the relationship between policymakers and evaluation?'
Date: 2013-Jun
An article said that the concept of evidence-based policy served as a convenient device for governments to present policy-making to a wider public, gaining legitimacy through an appeal to technical rationality and shielding underlying ideologies and politics from scrutiny. It illustrated this by reference to developments in housing policy, including public housing stock transfer, the housing market renewal programme, and the 2011 Localism Act. Although policy-makers continued to promote evidence-based policy, actual policy decisions were best explained by factors largely unrelated to 'evidence'; for example, the relative power and influence of interest groupings both within government and beyond.
Source: Keith Jacobs and Tony Manzi, 'Modernisation, marketisation and housing reform: the use of evidence based policy as a rationality discourse', People, Place & Policy, Volume 7 Issue 1
Links: Article
Date: 2013-Jun
A report examined what could be done to mobilize research knowledge more effectively across social policy and practice. It highlighted: the importance of high-quality initial research; translation of research into meaningful materials for practice; network-based brokerage; research partnerships in professional settings; evidence-based professional development; and (above all) the power of drawing these elements together as part of a functioning 'evidence ecosystem'.
Source: Jonathan Sharples, Evidence for the Frontline, Alliance for Useful Evidence
Links: Report
Date: 2013-Jun
A report examined how local authorities were using research evidence to help them reconcile substantial cuts in funding with increasing demand for services.
Source: Derrick Johnstone, Squaring the Circle: Evidence at the local level, Alliance for Useful Evidence
Links: Report
Date: 2013-May
An article examined tracking procedures designed to minimize attrition in longitudinal surveys through failure to locate sample members who moved. It said that survey practitioners should consider ways of improving their tracking procedures for certain groups of respondents.
Source: Lisa Calderwood, 'The role of respondent characteristics in tracking on longitudinal surveys: evidence from the UK Millennium Cohort Study', Longitudinal and Life Course Studies, Volume 4 Number 2
Links: Abstract
Date: 2013-May
A new book examined the relationship between research, policy-making, and practice, against the background of the evidence-based practice movement. It considered what counted as evidence for evidence-based practice; whether social measurement was possible, or necessary; and the criteria by which qualitative research should be judged. It also discussed the case for action research, the nature of systematic reviews, proposals for interpretive reviews, and the process of qualitative synthesis.
Source: Martyn Hammersley, The Myth of Research-Based Policy and Practice, SAGE Publications
Links: Summary
Date: 2013-Apr
A paper examined targeted response inducement strategies on longitudinal surveys – treating sample sub-groups differently, according to what was known about how best to achieve good participation in each one.
Source: Peter Lynn, Targeted Response Inducement Strategies on Longitudinal Surveys, Understanding Society Working Paper 2013-02, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract
Date: 2013-Mar
A new book examined research design for social scientists.
Source: Stephen Gorard, Research Design: Creating robust approaches for the social sciences, SAGE Publications
Links: Summary
Date: 2013-Mar
A paper examined the quality of sample design information in the EU-SILC dataset. It formulated recommendations for data producers about how to improve the quality of sample design variables, and for data users about how to make optimal use of the information that was already available in the dataset.
Source: Tim Goedeme, The EU-SILC Sample Design Variables: Critical review and recommendations, Working Paper 13/02, Centre for Social Policy (Antwerp University)
Links: Paper
Notes: EU-SILC = European Union Statistics on Income and Living Conditions
Date: 2013-Mar
The government responded to a report by a committee of MPs on its plans to abolish the 10-yearly population Census. It said that any replacement system for gathering data would take full account of the needs of users, including social scientists.
Source: The Census and Social Science: Government and Economic and Social Research Council (ESRC) Responses to the Committee s Third Report, Sixth Special Report (Session 2012–13), HC 1053, House of Commons Science and Technology Select Committee, TSO
Links: Response
Notes: MPs report (September 2012)
Date: 2013-Mar
A paper examined the advantages of collecting survey data online rather than by face-to-face interviewing. There was a potential reduction in data collection costs: but there were concerns that response rates could fall if the request to participate were no longer made in person, and that measurement could differ between modes. The paper presented initial findings from an experiment designed to test the effect on participation rates.
Source: Annette Jackle, Peter Lynn, and Jonathan Burton, Going Online with a Face-to-Face Household Panel: Initial results from an experiment on the Understanding Society innovation panel, Understanding Society Working Paper 2013-03, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract | Understanding Society press release
Date: 2013-Mar
A new book examined research techniques and standards for the evaluation of policy – and whether they amounted to an evaluation 'science'.
Source: Ray Pawson, The Science of Evaluation: A realist manifesto, SAGE Publications
Links: Summary
Date: 2013-Mar
An article examined spoken interaction in semi-structured qualitative research interviews, comparing those conducted by telephone with those conducted face-to-face.
Source: Annie Irvine, Paul Drew, and Roy Sainsbury, '"Am I not answering your questions properly?": clarification, adequacy and responsiveness in semi-structured telephone and face-to-face interviews', Qualitative Research, Volume 13 Number 1
Links: Abstract
Date: 2013-Feb
A report by a committee of peers criticized Research Councils UK for 'unacceptable' failures in the communication of its open access policy.
Source: The Implementation of Open Access, 3rd Report (Session 2012–13), HL 122, House of Lords Science and Technology Select Committee, TSO
Links: Report | Committee press release | Russell Group press release | Times Higher Education report
Date: 2013-Feb
An article said that there was a tension between conducting comprehensive systematic reviews and completing them in time to meet policy-making deadlines. The 'rapid evidence assessment' had been proposed as a solution to this: but this mode of reviewing presented considerable challenges in social policy. There were situations in which it might not be feasible to embark on a rapid review, and caution should be exercised when selecting this method.
Source: James Thomas, Mark Newman, and Sandy Oliver, 'Rapid evidence assessments of research to inform social policy: taking stock and moving forward', Evidence & Policy, Volume 9 Number 1
Links: Abstract
Date: 2013-Feb
A paper said that the respondent members of the general population sample of the Understanding Society survey closely resembled the Census 2001 population at the neighbourhood level – nationally and regionally.
Source: Jakob Petersen and Birgitta Rabe, Understanding Society: A Geographical Profile of Respondents, Understanding Society Working Paper 2013-01, Institute for Social and Economic Research (University of Essex)
Links: Working paper | Abstract
Date: 2013-Feb
An article examined the methodological approaches and challenges associated with tracing and contacting adults who had previously been 'hard to reach' children and young people identified as having behavioural problems. Using a variety of approaches, including social network sites, it had been possible to locate individuals in 69 per cent of cases.
Source: Helen Masson, Myles Balfe, Simon Hackett, and Josie Phillips, 'Lost without a trace? Social networking and social research with a hard-to-reach population', British Journal of Social Work, Volume 43 Number 1
Links: Abstract
Date: 2013-Jan
An article reported findings from two large-scale randomized experiments, carried out using the British Household Panel Survey, with survey features designed to reduce sample attrition. The first experiment compared strategies for obtaining updated contact information from sample members. It was found that the propensity to locate a sample member successfully was maximized by a between-wave mailing of a change-of-address card, rather than an address confirmation card or no card. The second experiment compared standardized and tailored respondent reports for young people and busy people. Tailored reports were found to have a modest positive effect on rates of co-operation for both groups, though the effect for busy people depended on providing the option of a shorter telephone interview instead of the full face-to-face interview.
Source: Laura Fumagalli, Heather Laurie, and Peter Lynn, 'Experiments with methods to reduce attrition in longitudinal surveys', Journal of the Royal Statistical Society: Series A, Volume 176 Issue 2
Links: Article
See also: Laura Fumagalli, Heather Laurie, and Peter Lynn, Experiments with Methods to Reduce Attrition in Longitudinal Surveys, Working Paper 2010-04, Institute for Social and Economic Research/University of Essex
Date: 2013-Jan
A paper examined strategies for reducing non-response in longitudinal studies.
Source: Ian Plewis, Statistical Guidance on Optimal Strategies to Reduce Nonresponse in Longitudinal Studies, Working Paper 2013-03, Centre for Census and Survey Research (University of Manchester)
Links: Paper
Date: 2013-Jan